Editing apparatus and editing method

ABSTRACT

An editing apparatus for a editing video sequence, comprises: an editing unit for setting a first range to one part of the video sequence; a video sequence file generating unit for generating a video sequence file including video sequence corresponding to the first range and video sequence corresponding to a second range, wherein the second range is consecutively preceding to and/or subsequent to the first range; and an output for outputting the video sequence file.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims the benefit, under 35 U.S.C. §365 ofInternational Application PCT/JP2008/000567, filed Mar. 13, 2008, whichwas published in accordance with PCT Article 21(2) on Oct. 30, 2008 inEnglish and which claims the benefit of Japanese patent application No.2007-106499, filed Apr. 13, 2007.

TECHNICAL FIELD

The present invention relates to an apparatus for and a method ofediting video sequence.

BACKGROUND ART

There is a variety of applications that perform, for example, image andaudio editing by using various video sequence, such as moving picturedata, static image data, audio data, and text data, in response toediting information that is received from a user; in addition, suchapplications are provided as software that functions on a personalcomputer, a workstation, and other information processing apparatuses.

Each of these applications is configured so that it generates a sequenceof video and audio data by executing an editing process that reads allor part of the various video sequence, such as image data and audio datastored in a storage medium, and splices desired portions thereoftogether.

With such an editing application, the editing target is handled asmultiple clips, each of which references video sequence in apredetermined temporal range, e.g., the editing application can beconfigured so that the clips are disposed on multiple tracks along atime axis after which an editing process is performed that correspondsto editing information received from the user.

It is conceivable to export an editing data file, wherein editinginformation is described, so that a clip that is being edited by oneapplication can be used by a different application. To make the editingdata file that can be used by all applications, it should be recordedwith a standardized description format, e.g., AAF (Advance AuthoringFormat), XML (Extensible Markup Language), EDL (Edit Decision List), orsome other format.

Patent Citation 1: Japanese Published Unexamined Patent Application No.2004-310889

DISCLOSURE OF INVENTION Technical Problem

If applications that exchange data are installed on the same computersystem or are capable of referencing the same video sequence via anetwork, then the applications may export an editing data file only.

However, if the application that uses the exported editing data filecannot reference the original video sequence, then the video sequencefile referred by the clip must be exported along with the editing datafile.

There is a problem in that, if the original video sequence are copiedand output as is as the video sequence file to be exported, thenquantity of excess data increases. Consequently, it is conceivable tocopy only a reference range that is referred by the clip from theoriginal video sequence, to generate a video sequence file, and toexport such.

There is a problem in that, if only the video sequence of the referencerange that is referred by the clip is exported as a data file, then theapplication that uses that data file cannot perform trimming, whereinthe reference range referred by the clip is expanded before a startpoint or after an end point thereof.

It is an object of the present invention to provide a novel and usefulediting apparatus and editing method. It is yet another object of thepresent invention to provide an editing apparatus and an editing methodwherein, when an editing apparatus exports a file including videosequence, it generates a file that can improve flexibility in editingthe video sequence at the export destination.

Technical Solution

A first aspect of the invention provides an editing apparatus forediting a video sequence, comprising: an editing unit for setting afirst range to one part of the video sequence; a video sequence filegenerating unit for generating a video sequence file including videosequence corresponding to the first range and video sequencecorresponding to a second range, wherein the second range isconsecutively preceding to and/or subsequent to the first range; and anoutput for outputting the video sequence file.

According to the present invention, if outputted video sequence file isedited by another editing apparatus or by software, then it is possibleto edit not only video sequence in the first range, but also videosequence in the second range, which is consecutively preceding to and/orsubsequent to the first range, which makes it possible to expand theeditable range and to improve the flexibility of editing. In addition,in the conventional case, when it is necessary to edit video sequencethat is before or after the first range, the editing apparatus mustreset and once again output the first range; however, according to thepresent invention, video sequence of the second range that isconsecutively preceding to and/or subsequent to the first range isincluded in the video sequence file, and therefore that troublesomeprocedure can be omitted.

A second aspect of the invention provides an editing method for editinga video sequence, comprising steps of: setting a first range to one partof the video sequence; generating a video sequence file, including thevideo sequence corresponding to the first range and video sequencecorresponding to a second range consecutively preceding to and/orsubsequent to the first range; and outputting the video sequence file.

According to the present invention, if outputted video sequence file isedited by another editing method or by software, then it is possible toedit not only video sequence in the first range, but also video sequencein the second range, which is consecutively preceding to and/orsubsequent to the first range, which makes it possible to expand theeditable range and to improve the flexibility of editing. In addition,in the conventional case, when it is necessary to edit video sequencethat is before or after the first range, the editing apparatus mustreset and once again output the first range; however, according to thepresent invention, video sequence of the second range that isconsecutively preceding to and/or subsequent to the first range isincluded in the video sequence file, and therefore that troublesomeprocedure can be omitted.

Advantageous Effect

The present invention can provide an editing apparatus and an editingmethod wherein, when an editing apparatus exports a file including videosequence, it generates a file that can improve flexibility in editingthe video sequence at the export destination.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram that shows a schematic configuration of anediting apparatus according to one embodiment of the present invention.

FIG. 2 is a functional block diagram of the editing apparatus accordingto one embodiment of the present invention.

FIG. 3 is an explanatory diagram that shows one example of an editingscreen generated by the editing apparatus according to one embodiment ofthe present invention.

FIG. 4 is an explanatory diagram that shows a data scheme in AAF format.

FIG. 5 is a control flow chart of the editing apparatus according to oneembodiment of the present invention.

FIG. 6 is an explanatory diagram that shows one example of a processingscreen of a project.

FIG. 7 is an explanatory diagram that shows one example of a detailedsettings screen during export.

FIG. 8 is a control flow chart according to another embodiment of thepresent invention.

FIG. 9 is an explanatory diagram that shows one example of a settingsscreen when a project file is being exported by another editingapparatus.

FIG. 10 is an explanatory diagram that shows one example of a menuscreen when the project file, which was edited by the other editingapparatus, is reimported.

FIG. 11 is an explanatory diagram that shows one example of an importdialog screen when the project file, which was edited by the otherediting apparatus, is reimported.

FIG. 12 is an explanatory diagram of the generation of a video sequencefile to be exported.

FIG. 13 is an explanatory diagram of another example of the generationof a video sequence file to be exported.

FIG. 14 is an explanatory diagram of yet another example of thegeneration of a video sequence file to be exported.

EXPLANATION OF REFERENCE

-   -   22 Instruction accepting unit    -   24 Editing unit    -   25 Information input unit    -   26 Editing data file unit    -   27 Video sequence file generating unit    -   28 Information output unit    -   100 Editing apparatus

BEST MODE FOR CARRYING OUT THE INVENTION

<Overview of the Invention>

An editing apparatus that integrates video sequence, such as movingpicture data, static image data, audio data, and text data, and editsmoving picture data, audio data, and the like can be implemented byusing a so-called personal computer terminal, e.g., a desktop computeror a laptop computer. In accordance with a user's editing instruction,the editing apparatus references video sequence, which is stored in abuilt-in or externally connected storage medium or in data storage thatresides on a network, and selects a clip that comprises time lengthinformation.

Editing data are generated by associating a clip ID with a videosequence reference range referred by the clip and a time axis timeposition of the video sequence generated by editing.

The editing apparatus manages the editing data of the clip thatreferences part or all of the video sequence. Sometimes, video sequencereferred by a clip and the editing data thereof are called a projectcollectively. Furthermore, a project does not necessarily need tocontain editing data.

When video sequence are exported for another application's use, theediting apparatus generates a video sequence file including videosequence, wherein a range referred by the clip is cut from the originalvideo sequence as needed.

In addition, the editing apparatus outputs an editing data fileincluding the video sequence file along with editing data. The editingapparatus may output a file wherein the video sequence file and theediting data file are integrated, i.e., a file including the videosequence and the corresponding editing data. Sometimes, such anintegrated file is called a project file.

Editing information is called project information, and editing datacontained in this project information are output as an editing data filethat is described in, for example, AAF, XML, EDL, or some other format.

The editing data file contains, for example, clip information, projectinformation, track information, head position information, and timelength information. The editing data file is configured so that itcontains position and length information about the video sequence (ofall the video sequence being edited) that are referred by the clip, andassociates the entirety of the video sequence with the video sequencethat are referred by the clip.

If the video sequence file cut from the original material data isincorporated in the project information, then it is generated by addingprescribed supplementary ranges to the reference range referred by theclip so that they are consecutively preceding to and/or subsequent tothe reference range.

<Hardware Configuration of the Editing Apparatus>

FIG. 1 is a block diagram that shows the hardware configuration of theediting apparatus according to one embodiment of the present invention.

Referring to FIG. 1, an editing apparatus 100 comprises a drive 101 fordriving an optical disc or some other storage medium, a CPU 102, RAM104, ROM 103, an HDD 105, a communication interface 106, an inputinterface 107, an output interface 108, decoder 109 and a bus 111 thatconnects them all.

A removable medium 101 a, such as an optical disc, is mounted to thedrive 101, and data are read out from the removable medium 101 a. FIG. 1shows a case wherein the drive 101 is built into the editing apparatus100, but the drive 101 may be an external drive. The drive 101 can use,for example, an optical disc as well as a magnetic disk, a magneto-opticdisk, a Blu-ray disc, or semiconductor memory. The read out of videosequence may be performed by a resource on the network to which aconnection can be made via the communication interface 106.

The CPU 102 loads a control program stored in the ROM 103 to a volatilestorage area in, for example, the RAM 104, and controls the operation ofthe entire editing apparatus 100 based thereon.

The HDD 105 stores an application program, which serves as the editingapparatus. The CPU 102 loads the application program to the RAM 104 andcauses the computer to function as the editing apparatus. In addition, aconfiguration is possible wherein the HDD 105 stores, for example, thevideo sequence read out from the removable media, e.g., an optical disc,and the editing data of each clip. Because the speed of access to thevideo sequence stored in the HDD 105 is faster comparatively than thatto an optical disc mounted to a disk drive, using video sequence storedon the HDD 105 during editing reduces display delay. As long as thestoring means of the editing data is capable of high speed access, it isnot limited to the HDD 105, e.g., it is possible to use a magnetic disk,a magneto-optic disk, a Blu-ray disc, or semiconductor memory. Inaddition, as the editing data storing means, it is possible to usestoring means of these types in a network wherein a connection can bemade to the storing means via the communication interface 106.

The communication interface 106 communicates with a video camera, whichis connected via, for example, a USB (Universal Serial Bus), andreceives data recorded on a storage medium in the video camera. Inaddition, the communication interface 106 is capable of transmittinggenerated editing data to a resource on the network via a LAN, theInternet, or the like.

The input interface 107 receives an instruction, which is input by theuser via an operation unit 200 such as a keyboard or a mouse, andsupplies an operation signal to the CPU 102 via the bus 111.

The output interface 108 supplies image data, audio data, and the likefrom the CPU 102 to an output apparatus 300, such as a speaker or adisplay apparatus, e.g., an LCD (liquid crystal display device) or CRT.

An AV unit 110 also executes various processes on a video signal and anaudio signal, and comprises the following elements and functions.

An external video signal interface 11 transfers the video signal betweenthe editing apparatus 100 and an external video encoder/decoder unit 12.For example, the external video signal interface 11 is provided with aninput-output unit for an analog composite signal and analog componentsignals.

The video encoder/decoder unit 12 decodes and performs analog conversionon the video data supplied via a video interface 13, and outputs theobtained video signal to the external video signal interface 11. Inaddition, the video encoder/decoder unit 12 performs digital conversionon the video signal supplied from, for example, the external videosignal interface 11 or an external video and audio signal interface 14as needed; subsequently, for example, the video encoder/decoder unit 12encodes the digital data in the MPEG-2 format and outputs the obtaineddata to the bus 111 via the video interface 13.

The video interface 13 transfers data between the video encoder/decoderunit 12 and the bus 111.

The external video and audio signal interface 14 outputs video data andaudio data, which are input from external equipment, to the videoencoder/decoder unit 12 and an audio processor 16, respectively. Inaddition, the external video and audio signal interface 14 externallyoutputs the video data supplied from the video encoder/decoder unit 12and the audio data supplied from the audio processor 16. For example,the external video and audio signal interface 14 is an SDI (SerialDigital Interface) compliant interface.

An external audio signal interface 15 transfers the audio signal betweenexternal equipment and the audio processor 16. For example, the externalaudio signal interface 15 is an analog audio signal standard compliantinterface.

The audio processor 16 performs analog/digital conversion on the audiosignal supplied from the external audio signal interface 15 and outputsthe obtained data to an audio interface 17. In addition, the audioprocessor 16 performs digital-analog conversion and audio adjustment onthe audio data supplied from the audio interface 17 and outputs theobtained signal to the external audio signal interface 15.

The audio interface 17 supplies data to the audio processor 16 andoutputs data from the audio processor 16 to the bus 111.

<Functional Configuration of the Editing Apparatus>

FIG. 2 is a block diagram that shows the functional configuration of theediting apparatus 100. Referring to FIG. 2, the CPU 102 of the editingapparatus 100 comprises various functional blocks, e.g., a userinterface unit 21, an editing unit 24, an information input unit 25, anediting data file generating unit 26, a video sequence file generatingunit 27, and an information output unit 28, all of which are implementedby an application program that is loaded to memory 104.

The various functional blocks described above implement an importfunction that inputs a project file containing video sequence, editingdata, or the like, an editing function, which edits the clips, an exportfunction, which exports the project file that contains the videosequence and/or the editing data, and a margin setting function, whichsets the margins of the video sequence when the project file isexported.

<Editing Function>

FIG. 3 shows one example of an editing screen of the editing apparatus100.

Referring to FIG. 3 along with FIG. 2, display data on the editingscreen are generated by a display control unit 23, and then output to adisplay of the output apparatus 300.

The editing screen 30 comprises: a playback window 31, which displays aplayback screen for edited content, acquired video sequence, and thelike; a timeline window 32 that comprises multiple tracks, wherein clipsare disposed along a timeline; and a video sequence window 33 (such as aBin window) that displays the acquired video sequence as icons.

The user interface unit 21 comprises an instruction accepting unit 22that accepts instruction input that is input by the user via theoperation unit 200, and the display control unit 23 that performsdisplay control with respect to the output apparatus 300, which is, forexample, a monitor or a speaker.

The editing unit 24 acquires video sequence referred by a clip, whichcomprises the video sequence referred by the clip that is specified byan instruction input by the user via the operation unit 200 or comprisesproject information that is specified by default, via an informationinput unit 25.

If material data stored on the HDD 105 are specified, then theinformation input unit 25 displays such in the video sequence window 33;if video sequence that are not recorded on the HDD 105 are specified,then the information input unit 25 reads out the video sequence from,for example, a resource on the network or a removable medium, anddisplays such as an icon in the video sequence window 33. This examplethree icons IC1-IC3 are displayed, each of which represents videosequence.

On the editing screen, the instruction accepting unit 22 accepts theinstruction of a clip that is used in editing, a reference range of thevideo sequence, and a time position that the reference range occupies onthe time axis of the content. Specifically, the instruction acceptingunit 22 accepts instructions, such as the clip ID, a start point and atime length of the reference range, and time information about thecontent wherein the clip is disposed. To achieve this, the user performsan operation in which he or she grabs the displayed clip name and thendrags and drops the icon of the desired video sequence onto thetimeline. By this operation, the instruction accepting unit 22 acceptsthe instructions of the clip ID, after which the selected clip isdisposed on the track with a time length that is in accordance with thereference range that is referred by the clip.

The start point, the end point, the temporal position on the timeline,and the like of the clip that is disposed on each track can be modifiedappropriately; for example, it is possible to input an instruction bymoving a mouse cursor that is displayed on the editing screen andperforming a prescribed operation.

<Project Export Function>

If video sequence containing at least one clip are used by anotherapplication, then the video sequence generating unit 27 generates avideo sequence file and outputs such via the information output unit 28.

In addition, an editing data file, wherein the editing data thatcorrespond to the video sequence are described in a format that can beused by that application, is generated and output via the informationoutput unit 28. The editing data file can use a format that can be usedin common among applications. That format is, for example, AAF, XML,EDL, or some other format.

FIG. 4 shows the structure of the editing information for each clipcontained in the editing data file in AAF format.

Referring to FIG. 4 along with FIG. 2, an editing data file 40comprises: a CompositionMob 41, which indicates a sequence name; aTimelineMobSlot 42, which indicates a track name, an editing unit (framerate/sample rate), and an attribute (video/audio); a Sequence 43, whichindicates the time length and an attribute; a SourceClip 44, whichindicates the head position in the video sequence and the length; aMasterMob 45, which indicates the clip name; and a FileSourceMob 46,which indicates the storage location of the video sequence referred bythe clip.

If an instruction is given to export the project, then the editing datafile generating unit 26 collects the editing data for the video sequencethat are being edited by the editing unit 24 and generates the editingdata file 40, which is described in a prescribed data format.

The video sequence file generating unit 27 cuts the video sequence fromthe original video sequence so that the video sequence includessupplementary ranges of prescribed lengths and the reference range. Thesupplementary ranges are consecutively preceding to and/or subsequent tothe reference range referred by the clip. The video sequence filegenerating unit 27 outputs the video sequence file.

Based on each clip contained in the video sequence being edited by theediting unit 24, the video sequence file includes video sequencegenerated by the video sequence file generating unit 27 from aprescribed resource.

The margin quantity of the supplementary ranges added to the materialdata file is specified by the user. In addition, it is possible to setthe margin quantity to a default value in accordance with, for example,an attribute of the data or the time length of the reference rangereferred by the clip.

FIG. 5 is a control flow chart of the editing apparatus according to thepresent embodiment. FIG. 6 is an explanatory diagram that shows oneexample of a processing screen for a project. FIG. 7 is a view thatshows one example of a detailed settings screen when exporting in theAAF format. Appropriately referring to FIG. 6 and FIG. 7, the procedureof specifying the margin quantity that is added to the material datafile by the user will now be explained based on the flow chart in FIG.5. This example will explain a case wherein the margins for each clipare batch set.

In step S11, the CPU 102 accepts the instruction of a condition, such asthe margin quantity when exporting a clip.

Specifically, if the CPU 102 accepts an instruction that is related tothe processing of a project, it displays a project processing screen 70,which is shown in FIG. 6. In the project processing screen 70, a menu isdisplayed that is related to saving and exporting a project and, if anexport bar 71 of a project is selected, then a menu window 72 isdisplayed that receives the format selection of the project editing datafile to be exported. In the example shown in FIG. 6, the menu window 72is configured so that AAF and EDL can be selected, but the presentinvention is not limited thereto.

If the format of the editing data file is specified, then an exportdetailed settings screen is displayed in accordance with that format,and instructions for the various detailed settings are received. Forexample, a detailed settings screen 80 as shown in FIG. 7 comprises avideo clip setting part 81, an audio clip setting part 82, and a filecopy setting part 83. In both the video clip setting part 81 and theaudio clip setting part 82, radio buttons can be used to make selectionssuch as “Copy material,” “Copy to one file,” and “Reference originalvideo sequence.”

In the file copy setting part 83, it is possible to select “Copy videosequence being used” and “Export range used by the clip.” Here, “Exportrange used by the clip” is selected and the margin quantity is selectedin a margin setting part 84. The margin quantity is specified, forexample, in a “h:m:s:frame” format. In the case of 30 frames/s videosequence, one frame is 1/30 s.

Next, in step S12, the CPU 102 executes an analysis process on theproject. Here, the tracks contained in the project, the time position ofthe clip disposed in each track, information about the video sequencereferred by the clip, and the like are collected.

In step S13, the CPU 102 determines whether the entirety of the videosequence referred by the clip has been exported. If it is determinedthat unexported video sequence exists, then the method transitions tostep S14; in addition, if it is determined that unexported videosequence does not exist, then the method transitions to step S18.

In step S14, the CPU 102 selects the unexported video sequence.

In step S15, if the set margin quantity is added, the CPU 102 determineswhether its range (in-out) from the start point to the end point fits inthe range (in-out) of the original video sequence from the start pointto the end point. If it is determined that, even if the set margin isadded, it will fit in the range of the original video sequence from thestart point to the end point, then the method transitions to step S16,but otherwise transitions to step S17.

In step S16, the video sequence generating unit 27 of the CPU 102generates and exports a video sequence file of the video sequencewherein supplementary ranges, each of which has the margin quantity setin step S11, are added to the start and end, respectively, of the videosequence reference range referred by the clip so that they aretemporally continuous therewith.

In step S17, the CPU 102 generates and exports a video sequence file ofvideo sequence that is limited to the range of the original videosequence from the start point to the end point.

After step S16 and step S17 end, the method transitions to step S13, andstep S13 through step S17 are repeated.

In step S18, the CPU 102 generates an editing data file by writing outthe project information based on the AAF format. If a video sequencefile is generated in step S16, then the editing data file containsinformation about the video sequence reference range referred by theclip and the supplementary ranges that are consecutively preceding toand/or subsequent to the reference range, respectively. In addition, ifa video sequence file is generated in step S17, then the editing datafile contains information about the video sequence reference rangereferred by the clip and the range of the original video sequence datafrom the start point to the end point. Furthermore, the editinginformation of each clip in the editing data file is modified so that itreferences the exported video sequence file.

Another Embodiment of Margin Quantity Settings

FIG. 8 is a control flow chart according to another embodiment. Thefollowing explains, based on the flow chart in FIG. 8, the case ofsetting the margin quantity for each clip, referencing FIG. 6 and FIG. 7where appropriate.

Next, in step S21, if export project is selected, then the CPU 102executes an analysis process on the project. Here, the tracks containedin the project, the time position of the clip disposed in each track,information about the video sequence referred by the clip, and the likeare collected.

In step S22, the CPU 102 determines whether the entirety of the videosequence referred by the clip has been exported. If it is determinedthat unexported video sequence exists, then the method transitions tostep S23; in addition, if it is determined that unexported videosequence does not exist, then the method transitions to step S28.

In step S23, the CPU 102 selects the unexported video sequence.

In step S24, the CPU 102 receives the specification of the marginquantity when the clip is exported. At this point, a window forspecifying the margin quantity is displayed, and the CPU 102 can receivethe specification of the margin quantity in the “h:m:s:frame” format,similar to that discussed above.

In step S25, if the set margin quantity is added, the CPU 102 determineswhether its range (in-out) from the start point to the end point fits inthe range (in-out) of the original video sequence from the start pointto the end point. If it is determined that, even if the set margin isadded, it will fit in the range of the original video sequence from thestart point to the end point, then the method transitions to step S26,but otherwise transitions to step S27.

In step S26, the video sequence generating unit 27 of the CPU 102 addssupplementary ranges, in accordance with the margin quantity set in stepS24, to the start and end, respectively, of the video sequence referencerange referred by the clip so that they are temporally continuoustherewith, generates a video sequence file, and exports such.

In step S27, the CPU 102 generates and exports a video sequence filethat is limited to the range of the original video sequence from thestart point to the end point.

After step S26 and step S17 end, the method transitions to step S22 andstep S22 through step S27 are repeated.

In step S28, the CPU 102 generates an editing data file by writing outthe project information based on the AAF format. If a video sequencefile is generated in step S26, then the editing data file containsinformation about the video sequence reference range referred by theclip and the supplementary ranges that are consecutively preceding toand/or subsequent to the reference range, respectively. In addition, ifa video sequence file is generated in step S27, then the editing datafile contains information about the video sequence reference rangereferred by the clip and the range of the original video sequence fromthe start point to the end point. Furthermore, the editing informationof each clip in the editing data file is modified so that it referencesthe exported video sequence file.

<Importing a Project>

The following explains a case wherein a project file, i.e., a file thatcontains video sequence and editing data, that is output by the editingapparatus according to the present invention is imported and used byanother editing apparatus (editing application). Here, an importingmethod will be explained for a case wherein an editing data filedescribed in the AAF format and a video sequence file that containsvideo sequence, to which the abovementioned supplementary ranges areadded, are read in and an editing process is further performed.

FIG. 9 is an explanatory diagram that shows one example of a settingsscreen that is used when the other editing apparatus imports a projectfile.

Referring to FIG. 9, an import settings screen 90 is displayed on theapplication side where the project file is imported.

The import settings screen 90 comprises a time code mapping optionssetting part 91. In the time code mapping options setting part 91, it ispossible to select the options of “Import taking the start point of theAAF file into consideration,” “Set head of timeline to start point ofAAF file and import,” and “Ignore start point of AAF file and import bytimecode.” An editing process can be executed based on the videosequence file, wherein the supplementary ranges are contained in thereference range referred by the clip, and the editing range can bedecompressed using the supplementary ranges, which makes it possible toperform the editing process with great flexibility.

<Reimporting a Project File after it has been Edited by Another EditingApparatus>

The following explains a case wherein a video sequence file containingvideo sequence, to which the abovementioned supplementary ranges areadded, is first exported so that it can be used by another editingapparatus (editing application), after which the video sequence file andthe editing data file, which have been further edited and output by thatediting apparatus, are reimported by the editing apparatus according tothe present embodiment.

FIG. 10 is an explanatory diagram that shows one example of a menuscreen that is used when a project that was edited by the other editingapparatus is reimported by the editing apparatus according to thepresent embodiment. This figure shows one example of a project importmenu screen.

Referring to FIG. 10, a project import menu screen 1000 comprises menubars, such as “Open project,” “Import sequence,” “Restore offline clip,”and “Import project,” and is configured so that an import bar 1001 ofthese menu bars for instructing the import of the project is selected,and so that, furthermore, a menu window 1002 for selecting the formatopens.

The menu window 1002 is configured so that selection bars for selectingany one of AAF and EDL, which serve as formats, can be displayed, and sothat a format can be specified.

If an import format is specified, then an import dialog is displayed forselecting the file to be imported.

FIG. 11 is an explanatory diagram that shows one example of an importdialog screen that is used when a project file that has been edited bythe other editing apparatus is reimported.

Referring to FIG. 11, an import dialog screen 1100 comprises: a storagelocation display part 1101, which indicates the storage location of thefile; a file name display part 1102, which displays the file name; afile type display part 1103, which displays the file type; and a filedisplay part 1104, which displays an icon of the file stored in thestorage location that is displayed in the storage location display part1101.

The AAF file to be imported can be imported by either clicking an icondisplayed in the file display part 1104 or clicking a file namedisplayed in the file name display part 1102.

As shown in FIG. 4, the imported AAF file comprises, for example,content information and information about the included clips, and alsocomprises information for associating the video sequence referred byeach clip with that clip. Accordingly, the video sequence file referredby each clip is simultaneously imported by the editing apparatus.

Similar to the process of importing at the other editing apparatus asdiscussed above, when the video sequence file is imported, it ispossible to select options, such as “Import taking start point of AAFfile into consideration,” “Set head of timeline to start point of AAFfile and import,” and “Ignore start point of AAF file and import bytimecode.”

At this point, if “Import taking start point of AAF file intoconsideration” is selected, then the video sequence file edited by theother editing apparatus is disposed using information about: the videosequence reference ranges referred by the source clips contained in theAAF file and that are set when exporting; and the supplementary rangesthat are temporally continuous with the start and end of the referencerange. Thereby, the clips of the video sequence file that was edited bythe other editing apparatus can be disposed so that the time axis is notshifted, even if they replace the pre-export clips.

In so doing, the video sequence file exported from the editing apparatusis further edited by the other editing apparatus, and it is thenpossible to reimport and edit such. At this time, it is possible toreduce the data quantity because a video sequence file is generated thatcuts out the vicinity of the range referred by the clip without usingthe original video sequence.

In addition, an editing process that cannot be performed by one editingapparatus is performed by the other editing apparatus; furthermore, ifthe latter returns its editing information to the editing apparatus,then it is possible to expand the scope of editing. At this time,including supplementary ranges that are temporally continuous with thestart and end, respectively, of the reference range referred by the clipmakes it possible to expand the scope of editing applications such astrimming, and thereby to perform a variety of editing functions.

<Video Sequence File to be Exported>

FIG. 12 is an explanatory diagram of the generation of a video sequencefile to be exported.

A clip 1211, which is disposed on a track 1210 shown in the middle partof FIG. 12, references one part (start point Ti to end point To) oforiginal video sequence 1200 shown in the upper part of FIG. 12. In sucha case, the video sequence file to be exported contains the videosequence file 1211 from the start point Ti to the end point To, andvideo sequence 1221, 1222 that are positioned before and after the videosequence file 1211, respectively, each of which has a specified marginquantity.

These supplementary ranges 1221, 1222 are cut from the original videosequence 1200 from a start point Tm1 to an end point Tm2, which containsthe margin portions.

If multiple clips reference the same video sequence and the end point ofa reference range referred by one clip is behind the start point of areference range referred by another clip, i.e., in a case whereinreference ranges overlap, then an editing apparatus (editingapplication), such as one that performs destructive editing (wherein thevideo sequence file referred by the clips is directly edited and itsvideo sequence are thereby updated), cannot reference themsimultaneously.

FIG. 13 is an explanatory diagram of another example of the generationof a video sequence file to be exported.

Referring to FIG. 13, this example is configured so that video sequencefiles are generated to which supplementary ranges, each of which has aprescribed margin quantity, are added to video sequence reference rangesreferred by each clip.

In the example shown in FIG. 13, the reference range that is referred bya first clip 1311, which is disposed in a first track 1310, extends froma start point T1 i to an end point T1 o, and the reference range that isreferred by a second clip 1321, which is disposed in a second track1320, extends from a start point T2 i to an end point T2 o.

In this case, a first video sequence file 1330 (start point Tm1 to endpoint Tm2), wherein supplementary ranges 1331, 1332 of prescribed marginportions are added to the reference range that is referred by the firstclip 1311, and a second video sequence file 1340 (start point Tm3 to endpoint Tm4), wherein supplementary ranges 1341, 1342 of prescribed marginportions are added to the reference range that is referred by the secondclip 1321, are output as the video sequence files to be exported.

Here, an example is shown wherein the first clip 1311 is disposed in thetrack 1310 and the second clip 1321 is disposed in the track 1320, butthe present invention is not limited to such a case, and the first clip1311 and the second clip 1321 may be disposed in the same track, or theymay be disposed so that their clips overlap on the time axis.

In the same manner as discussed above, in a case wherein multiple clipsreference the same video sequence and the end point of a reference rangereferred by one clip is behind the start point of a reference rangereferred by another clip, i.e., if the reference ranges overlap, then itis also possible to cut a single video sequence file from the startpoint of the reference range of one clip to the end point of thereference range of the other clip. As discussed above, in the case of anediting apparatus that performs destructive editing so that a videosequence file referred by a clip is directly edited and its videosequence are thereby updated, it is not possible to construct a singlevideo sequence file in the above manner, but it is possible to reducethe data quantity if the editing apparatus (editing application) is onethat performs a nondestructive editing process.

FIG. 14 is an explanatory diagram of yet another example of thegeneration of a video sequence file to be exported.

Referring to FIG. 14, consider a case wherein, for example, a referencerange that is referred by a first clip 1411, which is disposed on afirst track 1410, extends from a start point T1 i to an end point T1 o,and a reference range that is referred by a second clip 1421, which isdisposed in a second track 1420, extends from a start point T2 i to anend point T2 o.

In this case, the video sequence file to be exported contains videosequence 1430 (start point Tm1 to end point Tm2) that comprise videosequence from the start point T1 i of the reference range of the firstclip 1411 to the end point T2 o of the reference range of the secondclip 1421 and the video sequence of supplementary ranges 1431, 1432 thathave prescribed margin portions.

As discussed above, it is not possible to specify a supplementary rangethat extends beyond the original video sequence range from the startpoint to the end point (in-out), and therefore the original videosequence range from the start point to the end point is limited if themargin quantity is large.

In addition, a configuration is possible wherein a supplementary rangeis only added before the start point of the clip or after the end pointthereof.

Other Embodiments

A computer program that causes a computer to execute the methodsdiscussed above and a computer readable storage medium whereon thatprogram is recorded are included in the scope of the present invention.Here, a computer readable storage medium includes, for example, aflexible disk, a hard disk, a CD-ROM, an MO, a DVD, DVD-ROM, DVD-RAM, aBD (Blu-ray disc), and semiconductor memory.

The computer program is not limited to one that is recorded in thestorage medium, and may be transmitted via, for example, a network suchas an electric communication circuit, a wireless or wired communicationcircuit, or the Internet.

INDUSTRIAL APPLICABILITY

The present invention can be adapted to an editing apparatus forediting, for example, moving picture data and audio data.

The invention claimed is:
 1. An editing apparatus for exporting aproject file to an editing application for editing material data of anoriginal video or audio sequence, the apparatus comprising: an editingunit configured to automatically set a reference range for a videosequence that corresponds to a clip of the material data identified by auser to be exported to the editing application; a file generating unitconfigured to automatically select, based on the set reference range,the material data of the original video or audio sequence to generatethe video sequence that corresponds to the identified clip; a marginsetting unit configured to automatically set a margin quantity forsupplemental material data of the original video or audio sequence, themargin quantity having a time duration specified by a user of theediting apparatus; a margin addition unit configured to automaticallygenerate a supplemental range of the supplemental material data based onthe margin quantity, determine whether the supplemental range is withinan original range of the original video or audio sequence, and add thesupplemental material data to the selected material data when thesupplemental range is within the original range, the added supplementalmaterial data either consecutively preceding or following the selectedmaterial data; a video sequence file generator configured toautomatically create a video sequence file that includes the selectedmaterial data of the original video sequence and the added supplementalmaterial data; an editing data file generating unit configured toautomatically generate an editing data file including editinginformation about the video sequence file, the editing informationcomprising position and length information about the generated videosequence set by the reference range and information associating thegenerated video sequence and the supplemental material data with theoriginal video or audio sequence; a project file generator configured toautomatically generate a project file that includes the video sequencefile and the editing data file; and an output configured toautomatically export the project file to the editing application forediting the original video sequence and the supplemental material data.2. An editing apparatus according to claim 1, wherein the editinginformation corresponding to each range in the editing data file ismodified to reference the video sequence file.
 3. The editing apparatusaccording to claim 1, wherein the video sequence file generator isconfigured to generate two video sequence files including, a first videosequence file comprising material data corresponding to the referencerange and the supplemental reference range, and a second video sequencefile comprising material data corresponding to an additional referencerange set by the editing unit and an additional supplemental rangegenerated by the margin addition unit, and wherein the supplementalreference range is consecutively preceding to and/or subsequent to thereference range and the additional supplemental reference range isconsecutively preceding to and/or subsequent to the additional referencerange.
 4. The editing apparatus of claim 1, further comprising: an inputfor importing the video sequence file in a first edited state from theat least one other editing unit, wherein the material data is edited byat least one selected from a group consisting of the editing unit andthe at least one other editing unit, using at least one of the exportedvideo sequence file and the imported video sequence file.
 5. Theapparatus of claim 4, wherein the editing unit is further configured to:further edit the imported video sequence file.
 6. The apparatus of claim5, wherein the editing unit is further configured to: repeat exportingand importing of the video sequence file to further edit the videosequence file, wherein the editing unit or the at least one otherediting unit edits the material data based on at least one of the editsto the video sequence file.
 7. An editing apparatus according to claim1, further comprising: an input configured to import an edited videosequence file and a modified editing data file, the edited videosequence file being created by editing the exported video sequence fileby the editing application, wherein the video sequence of the editedvideo sequence file is associated with the original video sequence bythe modified editing data file.
 8. An editing method for exporting aproject file to an editing application for editing material data of anoriginal video or audio sequence, the method comprising: setting, by acomputer processor, a reference range for a video sequence thatcorresponds to a clip of the material data identified by a user to beexported to the editing application; selecting, by the computerprocessor and based on the set reference range, the material data of theoriginal video or audio sequence to generate the video sequence thatcorresponds to the identified clip; setting, by the computer processor,a margin quantity for supplemental material data of the original videoor audio sequence, the margin quantity having a time duration specifiedby a user of the editing apparatus; generating, by the computerprocessor, a supplemental range of the supplemental material data basedon the margin quantity; determining, by the computer processor, whetherthe supplemental range is within an original range of the original videoor audio sequence; adding, by the computer processor, the supplementalmaterial data to the selected material data when the supplemental rangeis within the original range, the added supplemental material dataeither consecutively preceding or following the selected material data;creating, by the computer processor, a video sequence file that includesthe selected material data of the original video sequence and the addedsupplemental material data; generating, by the computer processor, anediting data file including editing information about the video sequencefile, the editing information comprising position and length informationabout the generated video sequence set by the reference range andinformation associating the generated video sequence and thesupplemental material data with the original video or audio sequence;generating, by the computer processor, a project file that includes thevideo sequence file and the editing data file; and exporting, by thecomputer processor, the project file to the editing application forediting the original video sequence and the supplemental material data.9. An editing method according to claim 8, wherein editing informationcorresponding to each range in the editing data file is modified toreference the video sequence file.
 10. The editing method according toclaim 8, further comprising: generating two video sequence filesincluding, a first video sequence file comprising material datacorresponding to the reference range and the supplemental referencerange, and a second video sequence file comprising material datacorresponding to an additional reference range set by the editing unitand an additional supplemental range generated by the margin additionunit, and wherein the supplemental reference range is consecutivelypreceding to and/or subsequent to the reference range and the additionalsupplemental reference range is consecutively preceding to and/orsubsequent to the additional reference range.
 11. The method of claim 8,further comprising: importing the video sequence file in a first editedstate from the at least one other editing unit, wherein the materialdata is edited by at least one selected from a group consisting of theediting unit and the at least one other editing unit, using at least oneof the exported video sequence file and the imported video sequencefile.
 12. The method of claim 8, further comprising: importing an editedvideo sequence file and a modified editing data file, the edited videosequence file being created by editing the exported video sequence fileby the editing application, wherein the video sequence of the editedvideo sequence file is associated with the original video sequence bythe modified editing data file.
 13. A non-transitory computer-readablemedium having recorded thereon instructions for causing a computer toperform an editing operation for exporting a project file to an editingapplication for editing material data of an original video or audiosequence, wherein the instructions, when executed, perform the steps of:setting, by the computer, a reference range for a video sequence thatcorresponds to a clip of the material data identified by a user to beexported to the editing application; selecting, by the computer andbased on the set reference range, the material data of the originalvideo or audio sequence to generate the video sequence that correspondsto the identified clip; setting, by the computer, a margin quantity forsupplemental material data of the original video or audio sequence, themargin quantity having a time duration specified by a user of theediting apparatus; generating, by the computer, a supplemental range ofthe supplemental material data based on the margin quantity;determining, by the computer, whether the supplemental range is withinan original range of the original video or audio sequence; adding, bythe computer, the supplemental material data to the selected materialdata when the supplemental range is within the original range, the addedsupplemental material data either consecutively preceding or followingthe selected material data; creating, by the computer, a video sequencefile that includes the selected material data of the original videosequence and the added supplemental material data; generating, by thecomputer, an editing data file including editing information about thevideo sequence file, the editing information comprising position andlength information about the generated video sequence set by thereference range and information associating the generated video sequenceand the supplemental material data with the original video or audiosequence; generating, by the computer, a project file that includes thevideo sequence file and the editing data file; and exporting, by thecomputer, the project file to the editing application for editing theoriginal video sequence and the supplemental material data.
 14. Thecomputer readable medium according to claim 13, wherein the editingmethod further comprises: receiving an instruction related to the lengthof the additional reference range.
 15. The computer readable mediumaccording to claim 13, wherein the instructions, when executed, furtherperform the steps of: generating two video sequence files including, afirst video sequence file comprising material data corresponding to thereference range and the supplemental reference range, and a second videosequence file comprising material data corresponding to an additionalreference range set by the editing unit and an additional supplementalrange generated by the margin addition unit, and wherein thesupplemental reference range is consecutively preceding to and/orsubsequent to the reference range and the additional supplementalreference range is consecutively preceding to and/or subsequent to theadditional reference range.
 16. An editing apparatus for generating andexporting an editable video sequence configured to be trimmed by a videoediting application, the apparatus comprising: a reference rangegenerator configured to automatically set a reference range thatcorresponds to a clip of original material data to be edited by thevideo editing application; a video sequence generator configured toautomatically select a video sequence from the original material databased on the set reference range that corresponds to the identifiedclip; a supplemental range generator that receives a margin quantity andautomatically generates a supplemental range of the original materialdata that either consecutively precedes and/or consecutively follows theset reference range for the identified clip of the original materialdata; a supplemental content identifier that automatically accessessupplemental material data in the original material data based on thegenerated supplemental range of the original material data; and a videosequence file generator that automatically generates a video sequencefile comprising the editable video sequence by combining the accessedsupplemental material data and the selected video sequence, wherein theeditable video sequence is configured to be edited by the video editingapplication by trimming at least a portion of the supplemental materialdata.
 17. The editing apparatus of claim 16, further comprising anoutput configured to export the project file to the editing application.18. The editing apparatus of claim 16, wherein the reference rangegenerator is configured to automatically set the reference range for theclip of the original material data based on a user input by a user ofthe editing apparatus.
 19. The editing apparatus of claim 16, whereinthe supplemental range generator automatically generates thesupplemental range based on the margin quantity having a duration thatis specified based on a user input by a user of the editing apparatus.20. The editing apparatus of claim 16, further comprising an editingdata file generator that automatically generates an editing data filethat includes editing information relating to the selected videosequence, including position and length information about the selectedvideo sequence set by the set reference range and informationassociating the original material data, the selected video sequence andthe supplemental material data.
 21. The editing apparatus of claim 20,further comprising a project file generator configured to generate aproject file that includes the generated video sequence file and theediting data file.
 22. The editing apparatus of claim 16, wherein thevideo sequence file generator is configured to generate a single videosequence file when the video editing application is configured toperform nondestructive editing, and to generate a pair of video sequencefiles when the video editing application is configured to performdestructive editing.
 23. The editing apparatus of claim 16, wherein thesupplemental range generator automatically generates a pair ofsupplemental ranges of the original material data that consecutivelyprecede and consecutively follow, respectively, the set reference rangefor the identified clip of the original material data.
 24. An editingapparatus for generating and exporting an editable video sequenceconfigured to be trimmed by a video editing application, the apparatuscomprising: a reference range generator configured to automatically seta reference range that corresponds to a clip of original material datato be edited by the video editing application; a video sequencegenerator configured to automatically select a video sequence from theoriginal material data based on the set reference range that correspondsto the identified clip; a supplemental range generator that receives amargin quantity and automatically generates a supplemental range of theoriginal material data that either consecutively precedes and/orconsecutively follows the set reference range for the identified clip ofthe original material data; a supplemental content identifier thatautomatically accesses supplemental material data in the originalmaterial data based on the generated supplemental range of the originalmaterial data; and a video sequence file generator that, when the videoediting application is configured to perform nondestructive editing,automatically generates a single video sequence file comprising theeditable video sequence by combining the accessed supplemental materialdata and the selected video sequence, wherein the editable videosequence is configured to be edited by the video editing application bytrimming at least a portion of the supplemental material data, wherein,when the video editing application is configured to perform destructiveediting, the video sequence file generator generates a pair of videosequence files each comprising the editable video sequence by combiningthe accessed supplemental material data and the selected video sequence.25. The editing apparatus of claim 24, further comprising an outputconfigured to export the project file to the editing application. 26.The editing apparatus of claim 24, further comprising an editing datafile generator that automatically generates an editing data file thatincludes editing information relating to the selected video sequence,including position and length information about the selected videosequence set by the set reference range and information associating theoriginal material data, the selected video sequence and the supplementalmaterial data.
 27. The editing apparatus of claim 24, wherein the videoediting application performs destructive editing of one of the pair ofvideo sequence files by directly editing and updating the video sequencefile, and the video editing application performs non-destructive editingof the single video sequence file when the video sequence file is notdirectly edited and updated by the video editing application.
 28. Theediting apparatus of claim 24, wherein the reference range generator isconfigured to automatically set the reference range for the clip of theoriginal material data based on a user input by a user of the editingapparatus.
 29. The editing apparatus of claim 24, wherein thesupplemental range generator automatically generates the supplementalrange based on the margin quantity having a duration that is specifiedbased on a user input by a user of the editing apparatus.
 30. Theediting apparatus of claim 26, further comprising a project filegenerator configured to generate a project file that includes thegenerated video sequence file and the editing data file.
 31. The editingapparatus of claim 24, wherein the supplemental range generatorautomatically generates a pair of supplemental ranges of the originalmaterial data that consecutively precede and consecutively follow,respectively, the set reference range for the identified clip of theoriginal material data.
 32. An editing apparatus for generating andexporting an editable video sequence configured to be trimmed by a videoediting application, the apparatus comprising: a reference rangegenerator configured to automatically set a reference range thatcorresponds to a clip of original material data to be edited by thevideo editing application; a video sequence generator configured toautomatically select a video sequence from the original material databased on the set reference range that corresponds to the identifiedclip; a supplemental range generator that receives a margin quantity andautomatically generates a supplemental range of the original materialdata that either consecutively precedes and/or consecutively follows theset reference range for the identified clip of the original materialdata; a supplemental content identifier that automatically accessessupplemental material data in the original material data based on thegenerated supplemental range of the original material data; and a videosequence file generator that automatically generates a video sequencefile comprising the editable video sequence by combining the accessedsupplemental material data and the selected video sequence, wherein theeditable video sequence is configured to be edited by the video editingapplication by trimming at least a portion of the supplemental materialdata, wherein the reference range generator is configured toautomatically set, in response to a request of a user of the editingapparatus, a first reference range that corresponds to a first clip oforiginal material data and a second reference range that corresponds toa second clip of original material data, wherein the second referencerange is subsequent to the first reference range, wherein the videosequence generator automatically selects first and second videosequences from the original material data based on the set first andsecond reference ranges that corresponds to the identified first andsecond clips, wherein the supplemental range generator is furtherconfigured to automatically generate respective first and secondsupplemental ranges for each of the first and second reference rangesthat consecutively precede and consecutively follow, respectively, thefirst and second reference ranges for the identified first and secondclips of the original material data, wherein the supplemental contentidentifier automatically accesses supplemental material data in theoriginal material data based on the generated first and secondsupplemental ranges of the original material data, and wherein the videosequence file generator automatically generates a video sequence filecomprising the editable video sequence by combining the accessedsupplemental material data and the selected first and second videosequences, wherein the editable video sequence is configured to beedited by the video editing application by trimming at least a portionof the supplemental material data.
 33. The editing apparatus of claim32, further comprising an output configured to export the project fileto the editing application.
 34. The editing apparatus of claim 32,wherein the reference range generator is configured to automatically setthe reference range for the clip of the original material data based ona user input by a user of the editing apparatus.
 35. The editingapparatus of claim 32, wherein the supplemental range generatorautomatically generates the supplemental range based on the marginquantity having a duration that is specified based on a user input by auser of the editing apparatus.
 36. The editing apparatus of claim 32,further comprising an editing data file generator that automaticallygenerates an editing data file that includes editing informationrelating to the selected video sequence, including position and lengthinformation about the selected video sequence set by the set referencerange and information associating the original material data, theselected video sequence and the supplemental material data.
 37. Theediting apparatus of claim 36, further comprising a project filegenerator configured to generate a project file that includes thegenerated video sequence file and the editing data file.
 38. The editingapparatus of claim 32, wherein the video sequence file generator isconfigured to generate a single video sequence file when the videoediting application is configured to perform nondestructive editing, andto generate a pair of video sequence files when the video editingapplication is configured to perform destructive editing.
 39. Theediting apparatus of claim 38, wherein the video editing applicationperforms destructive editing of one of the pair of video sequence filesby directly editing and updating the video sequence file, and the videoediting application performs non-destructive editing of the single videosequence file when the video sequence file is not directly edited andupdated by the video editing application.
 40. The editing apparatus ofclaim 32, wherein the supplemental range generator automaticallygenerates a pair of supplemental ranges of the original material datathat consecutively precede and consecutively follow, respectively, theset reference range for the identified clip of the original materialdata.